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METHOD AND SYSTEM FOR TRANSMITTING DATA 
UTILIZING MULTIPLE COMMUNICATION MODES SIMULTANEOUSLY 



FIELD OF THE INVENTION 

The present invention relates to networked communications, and more particularly to, a 
method and system for transmitting data utilizing a plurality of communication modes in a 
communication device simultaneously. 

BACKGROUND OF THE INVENTION 

Hand held communication devices, such as mobile telephones and PDAs, currently 
are adapted to incorporate a variety of functions and to support multiple mechanisms of 
communication. For example, a mobile phone can provide traditional wireless telephone 
functions, while also providing the ability for a user to capture digital images and the ability 
to transmit or receive captured images for display on the phone's LCD. Indeed, the modern 
mobile phone allows the user to send and receive text messages, audio and video clips, 
graphics and images via electronic mail, Short Message Service (SMS) or Multimedia 
Message Service (MMS), in addition to simply talking to another caller. It is foreseeable 
that advances in technology will produce personal communication devices that support even 
more mechanisms of information exchange, such as ftp and other types of direct 
connections. 

Each communication mechanism is associated with a particular addressing scheme, 
such as a phone number for phone calls, an email address for electronic messages, or an http 
URL for posting images. The personal communication devices that support a wide range of 
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communication mechanisms, generally treat each mechanism separately. This can present 
challenges for the user who wishes to exchange information that cannot be sent, or is 
inconvenient to send, over a single mechanism. 

For example, the user may be speaking to a customer by phone and may want the 
customer to view a document. With the current communication device, the user would be 
required to implement two separate data exchange mechanisms, e.g. phone communication 
and electronic mail, and also would be required to know the caller's address scheme, e.g., 
phone number and email address, associated with each mechanism. In operation, the caller 
would use the communication device, e.g., mobile phone, to call the customer using the 
customer's phone number, terminate the call, setup the mobile phone to send an email 
message with the attached document, provide or select from the device's address book the 
customer's email address, transmit the email message, and reestablish the telephone call 
with the customer. Accordingly, while current communication devices support multiple 
communication mechanisms, utilizing such mechanisms is cumbersome and inefficient. 

Accordingly, a need exists for a communication device that supports a plurality of 
communication mechanisms in an integrated manner such that the user can easily implement 
more than one mechanism simultaneously. The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

The present invention is related to a method for transmitting data utilizing a plurality of 
communication applications simultaneously in a communication device supporting the 
plurality of communication applications, and a communication device for implementing the 
method. The method according to the present invention includes establishing a first 
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communication session between a user of the communication device and a recipient via a first 
communication application supported by the communication device, invoking a second 
communication application to transmit data to the recipient via the second communication 
application during a communication session concurrent with the first communication session, 
and, in response to invoking the second communication application, automatically retrieving 
communication information related to the recipient and necessary to establish the concurrent 
communication session via the second communication application. 

Through aspects of the present invention, communication information related to a 
recipient for all communication mechanisms supported by a device are integrated. 
Accordingly, the user is not required to know more than one address for the recipient because 
the device automatically associates the needed addresses and connection setup information to 
manage all other modes of communication supported by the device. In addition, the 
information exchange using the second mode of communication occurs concurrently with the 
initial communication session. Thus, the user's initial communication session continues 
without interruption. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram illustrating the communication device according to a 
preferred embodiment of the present invention. 

Figure 2 is a flowchart illustrating a method for integrating a plurality of 
communication mechanisms utilizing related addressing information in accordance to a 
preferred embodiment of the present invention. 

Figure 3 is a schematic representation of an exemplary profile. 
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Figure 4 is a flowchart illustrating a process for automatically populating a recipient 
profile from a recipient device in accordance to a preferred embodiment of the present 
invention. 

Figures 5A-5C illustrate different system architecture for the preferred embodiment of 
the present invention. 

DETAILED DESCRIPTION 

The present invention relates to networked communications, and more particularly to, a 
method and system for transmitting data utilizing a plurality of communication modes in a 
communication device simultaneously. The following description is presented to enable one of 
ordinary skill in the art to make and use the invention and is provided in the context of a patent 
application and its requirements. Various modifications to the preferred embodiment and the 
generic principles and features described herein will be readily apparent to those skilled in the 
art. For example, while the preferred embodiment is described as a mobile phone, the 
principles described can also be applied to any communication device, such as a PDA, or 
laptop computer. Thus, the present invention is not intended to be limited to the embodiment 
shown but is to be accorded the widest scope consistent with the principles and features 
described herein. 

According to a preferred embodiment of the present invention, a personal 
communication device, e.g., mobile phone, includes an integration module that integrates the 
various communication mechanisms (also referred to as "communication applications") 
supported by the mobile phone. The integration module allows the user to conduct a 
communication session with a recipient using a first mode of communication, and to initiate 
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a second mode of communication during the communication session to transmit data to the 
recipient using that second mode. When the second communication mode is initiated, the 
integration module automatically retrieves communication information necessary to 
establish a concurrent communication session with the recipient using the second 
communication mode. Depending on the communication mode, the communication 
information can include phone numbers, email addresses, URLs for personal or business 
websites and web services, static and dynamic IP addresses, and the like. Because related 
communication information is automatically retrieved by the device, the user need only enter 
one address for the information recipient, e.g., to set up the initial communication session. 
The integration module automatically associates other addresses and connection setup 
information to manage all other modes of communication. 

Figure 1 is a block diagram illustrating the communication device according to a 
preferred embodiment of the present invention. The communication device 100 includes 
memory 140, an integration module 130, a communication application module 1 10 and a 
connection interface 120. Preferably, the communication device 100 is one that supports at 
least two communication modes, such as the following, for example: 

• Initiate and receive phone calls 

• Email 

• SMS 

• MMS 

• Initiate and receive direct network connections 

• Initiate and receive other datagram/packet type exchanges 

Each communication mode is controlled by a corresponding communication application 
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1 10a-l lOd in the communication application module 1 10. While four communication 
applications are shown in Figure 1, those skilled in the art readily appreciate that other 
communication devices can support additional communication applications, and that the 
present invention is not intended to be limited in this manner. The communication 
application module 1 10 is in communication with the connection interface 120, via a bus 
1 15, for example. The connection interface 120 enables data transmission to another 
communication device on a network (not shown). There are a number of standard 
connection interfaces 120 depending on the programming language used. Two such 
interfaces include a sockets interface for C/C++ program code and ajava.net interface for 
Java program code for example. The connection interface 120 is well known to those skilled 
in the art and will not be further described here. 

According to the preferred embodiment of the present invention, the communication 
device 100 also includes the integration module 130, which is in communication with the 
communication application module 1 10 via data bus 125 for example. The integration module 
130 includes a communication monitor 132 and an address mapper 134. The communication 
monitor 132 is primarily responsible for detecting and identifying any communications that are 
ongoing at any given time. In a preferred embodiment, a communication application, e.g., the 
email application 1 10b, notifies the communication monitor 132 when the user invokes the 
application 1 10b, e.g., to transmit data via email. When the transmission is completed, the 
application, e.g., 1 10b, similarly informs the monitor 132. In this manner, the monitor 132 
keeps track of which applications 1 10a-l lOd are being utilized at any given time. The address 
mapper 134 is primarily responsible for returning addresses and connection setup information, 
i.e., communication information, to a requesting communication application 1 10a-l lOd. 
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Together, the communication monitor 132 and the address mapper 134 enable the device 100 
to integrate its plurality of communication mechanisms. 

Figure 2 is a flowchart illustrating a method for integrating a plurality of 
communication mechanisms utilizing related addressing information in accordance to a 
5 preferred embodiment of the present invention. The process begins at step 200, when the 

user of the communication device establishes a communication session with a recipient via 
one of the communication applications, e.g., phone call 1 10a. Presumably, the user provides 
the appropriate address information needed, e.g., phone number, to establish the session with 
the recipient using the chosen communication application. 

io At some point during the session, the user wishes to transmit data to the recipient, or 

someone associated with the recipient, utilizing another communication application, e.g., 
email 1 10b, and invokes the second communication application 1 10b (step 202) in order to 
facilitate the establishment of a second communication session concurrent with the already 
established communication session. In one embodiment, the user directly invokes the 

15 second communication application 1 10b, by pressing a softkey corresponding to the 

application 1 10b, for example. In another embodiment, the user submits a data transmission 
request to the device 100 and selects the data to transmit. In response, the device 100 
automatically invokes the appropriate communication application to handle the selected 
data. For example, if the user submits a request to transmit data and selects an image file to 

20 transmit, the device 100 automatically invokes the MMS application 1 lOd or email 

application 110b. 
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It is important to note at this time that Figure 2 illustrates the integration process 
from the perspective of the user's communication device and that the device allows the user 
to invoke the second communication application 1 10b in step 202. Nevertheless, if the 
recipient's communication device is similarly enabled, the recipient can also initiate and 
establish the concurrent communication session by invoking the second communication 
application supported by the recipient's device. Accordingly, the ability to perform step 202 
is not limited to the party who established the first communication session, i.e., the user. If 
both the user and the recipient are utilizing communication devices enabled by the present 
invention, either party can transmit data to the other utilizing more than one communication 
application simultaneously. 

Referring again to Figure 2, once the second communication application 1 10b has 
been invoked, it queries the communication monitor 132 to determine whether an ongoing 
communication session has been established in step 204. If an ongoing session exists, the 
communication monitor 132 returns the communication information used to establish the 
ongoing session with the recipient in step 206. For example, if the ongoing session is a 
phone call, the monitor 132 might return the phone number, or some representation 
associated with the phone number, used to establish the call. The second application 1 10b 
then takes the communication information returned from the monitor 132 and queries the 
address mapper 134 for the related communication information necessary to establish the 
concurrent session with the recipient in step 208. Such a query includes the communication 
information used to establish the ongoing session as an input parameter and the related 
communication information for the second communication application as an output 
parameter. 
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In step 210, the address mapper 134 retrieves and returns the related address 
information by accessing a plurality of profiles 142 (Figure 1) stored in memory 140. In a 
preferred embodiment, each profile 142 is associated with a data transmission recipient, as 
well as with the device's user. Figure 3 is a schematic representation of an exemplary 
profile 300 for a recipient, Jane Smith. The profile 300 includes any communication 
information 302, e.g., address and connection setup information, needed to establish any 
supported mode of communication with the associated recipient. For example, Jane Smith's 
profile 300 indicates that she can be called at (999) 123-1233, and that she allows others to 
upload pictures to her account at SnapFish into her "guest" folder. Moreover, she allows 
others to upload documents to her company's ftp server into her guest subdirectory. A guest 
userid and password is provided in an encrypted format. 

The communication information 302 can be specific to the recipient or to a 
communication device associated with that recipient or to an individual or organization 
associated with recipient. For example, communication information 302 specific to the 
recipient includes the email address of the recipient and the recipient's personal website 
URL, while communication information 302 specific to the device includes the device's 
phone number and the IP address associated with the device. Communication information 
302 specific to an associated individual or organization can include the phone number of the 
recipient's supervisor, or the ftp server address for the recipient's employer, etc. What 
should be clear is that the recipient is allowed to define the related communication 
information 302 in the profile 300 in whatever manner he or she wishes. Note that the 
profile 300 includes dynamic, as well as static addressing information. An example of a 
dynamic address includes an IP address dynamically assigned to a device using DHCP for IP 
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address assignment. In a preferred embodiment, the plurality of profiles 300 corresponds to 
the device's preexisting address book. 

A profile 300 can be populated manually by the user keying in the relevant data. 
Nevertheless, frequently the user is not aware of all the communication information for a 
recipient. For example, the user may know a recipient's phone number, but not the 
recipient's email address. Thus, the profile 300 for that recipient will be incomplete and the 
user must query the recipient for the missing information. If, however, the recipient's device 
is one that incorporates the present invention, the address mapper 134 can automatically 
populate the profile 300 for a recipient during a communication session with that recipient. 

Figure 4 is a flowchart illustrating a process for automatically populating a recipient 
profile 300 from a recipient device in accordance to a preferred embodiment of the present 
invention. In step 400, the user designates his or her user profile, and in step 402, the 
address mapper 134 updates any dynamic address information for the user profile 300. In 
step 404, the user initiates the first communication session with the recipient. Once the 
communication session is established, the user device and the recipient device exchange 
their respective profiles 300 in step 406, via a transport such as SMS, for example. The 
exchange can either be automatic or in response to a prompt asking whether such an 
exchange is desirable. The profile 300 received by the user is used to create a profile or to 
update an existing profile 300 for the recipient in step 408, while the recipient does the same 
with the profile 300 received from the user. In step 410, the newly populated or updated 
profile 300 is stored in memory 140. 
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Referring again to Figure 2, once the address mapper 134 retrieves and returns the 
appropriate related communication information to the second communication application 
1 10b (step 210), the second communication application 1 10b automatically uses the returned 
communication information to establish the concurrent communication session and transmits 
the data by the second communication mode in step 212. In certain circumstances, the 
communication information returned for a recipient might include several entries. For 
example, the recipient may have more than one related email address, a personal address, a 
business address, and the address of the recipient's supervisor. Here, the address mapper 
134 will display to the user the addresses and will then allow the user to select the 
appropriate address. Once the user makes his or her selection, the communication 
application 1 10b automatically uses the selected address information to establish the 
connection and transmits the data (step 212). If the user would like to invoke another 
communication application (step 214), steps 202 through 212 are repeated. Otherwise, the 
ongoing communication session continues normally (step 216). 

It is important to note that while the second communication application 1 10b is 
interacting with the integration module 130 to automatically retrieve the communication 
information needed to establish the concurrent communication session, the first ongoing 
communication session continues uninterrupted. Moreover, because the communication 
application 1 10b automatically receives the related communication information it needs, the 
user is not required to know or provide such information. 

In the above described preferred embodiment, the device 100 includes a local address 
mapper 134 and memory 140 for storing the profiles 142. Figure 5A illustrates one system 
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architecture utilizing two devices 100a, 100b with this configuration. In this system, both 
devices 100a 3 100b connect to a network 500, such as the Internet. The devices 100a, 100b 
are able to manage the networking between themselves and use their respective address 
mappers 134a, 134b for address mapping. In this embodiment, the devices 100a, 100b can 
exchange profiles automatically thereby enabling the automatic profile population feature 
described above. 

In Figure 5B, another system architecture is depicted where devices 100a, 100b use 
an Address Mapper Server 520 to store profiles 142' and to process mapping requests. The 
local address mapper 134a, 134b in each device 100a, 100b preferably manages the 
interaction between the device 100a, 100b and the address mapper server 520. By storing 
profiles 142' on a separate server 520, the device's memory 140 is preserved. While Figure 
5B illustrates a single server 520, those skilled in the art would readily appreciate that 
multiple servers can be utilized by multiple devices 100a, 100b. 

In Figure 5C, a third system architecture is depicted where the devices 100a, 100b are 
not connected to a common network, but rather can only be addressed via a gateway 530a, 
530b using an addressing scheme that enables each device 100a, 100b to be addressed. For 
example, a WAP gateway allows WAP enabled mobile phones to access data on the Internet, 
and allows Internet connected devices to send messages to the WAP enabled mobile phone. 
In this system, each device 100a, 100b send requests to the address mapper server 520 
through the associated gateway 530a, 530b using the network protocol of the device's 
network 500a, 500b. The gateway 530a, 530b routes the request to the server 520 using the 
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protocol of the backbone network (not shown), e.g., TCP/IP. Responses from the server 520 
are returned to the gateway 530a, 530b, which routes the response to the device 100a, 100b. 

Through aspects of the present invention, address and connection setup information 
for all communication mechanisms supported by a device are integrated. The 
communication device 100 according to the preferred embodiment allows the user to initiate 
a communication session with the recipient using a particular mode of communication. If 
data needs to be exchanged using a second mode of communication during the session, the 
communication information for the second mode is provided automatically. Accordingly, 
the user is not required to know more than one address for the recipient because the device 
automatically associates the necessary communication information to manage all other 
modes of communication supported by the device. In addition, the information exchange 
using the second mode of communication occurs concurrently with the initial 
communication session. Thus, the user's initial communication session is not interrupted. 

Although the present invention has been described in accordance with the 
embodiment shown, one of ordinary skill in the art will readily recognize that there could be 
variations to the embodiments and those variations would be within the spirit and scope of 
the present invention. Accordingly, many modifications may be made by one of ordinary 
skill in the art without departing from the spirit and scope of the appended claims. 
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